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1.0 INTRODUCTION 

Optical measurements of range and elevation angle are distorted by the Earth's 
atmosphere as shown in figure 1 . 


Ray 



Figure 1.- Refraction effects. 

For long ranges, the measured elevation angle % may deviate from the true ele- 
vation angle E by several milliradians , and measured range may differ 

from true range P by several meters. Even short-range measurements are 
affected by refraction, and the effects are cumulative. 

Intuition may lead one to think that refraction effects are minor when the eleva- 
tion angle is near zero. Exactly the opposite is true. E^-E increases with a 
decreasing elevation angle, and the ray path becomes more curved. Also to be 
noted is that a laser ranging device can not be compensated to give a true range 
measurement by using the speed of light in the atmosphere, at the instrument. 

This will not include the effects of the ray path bending and the passage 
through higher or lower layers of atmosphere, where the speed of light differs 
from that at the instrumer*- . The equations in this report assume that measured 
range is obtained by using the speed of light in a vacuum (index of refraction 
n=1) . 

The work presented in this report is a spinoff of the Space Shuttle Program. 

The high precision refraction correction equations in this report are being used 
to evaluate approximate refraction correction equations developed at the NASA 
Johnson Space Center. It wa3 determined that the equations in this report were 
ideally suited for surveying since their inputs are optically measured range and 
optically measured elevation angle. The outputs are true straight-line range 
and true geometric elevation angle. The "short" distances used in surveying 
allow the calculations of true range and true elevation angle to be quickly made 
using a programable pocket calculator. 
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2.0 THE SPHERICAL FORM OF SNELL'S LAW 

Let n be the index of refraction. A light ray traveling from one media (n*) 
to another (n^+i) is bent according to Snell's law (fig. 2). 


ni +1 sin = ni sin 4>i 



Figure 2.- Snell's law. 

Figure 3 shows how Snell's law can be applicable to concentric spherical 
surfaces . 
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C 


Figure 3.- Ray path across spherical surfaces. 
From the ABC triangle in figure 3 and from the law of sines, 

R i Ri+1 R i+1 

sin sin(l80 - <J>^) sin 4>^ 


or 


Ri + 1 sin ^ = Ri sin 


But from Snell's law of refraction, 
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n i+1 

sin \|» = sin 4>i+i 

n i 

Thus, 

ni+1 

R i+1 sin <|»i + i = Ri sin 4>i 

n i 

or 

»i+1 R i+1 sin 4>i+1 = n i R i ® in <t>i 
In the next layer, it is easily seen that 

n i+2 R i+2 sin *i+2 s n i R i sin $i 
or, in general, 

nR sin $ = n^Ri sin 
Elevation angle E^ is defined by 
% = 90 - 4> 

As a result, the spherical form of Snell’s law is developed: 

J ! 

! nR cos E^ * n^Ri cos E^i ! 
l ! 

The elevation angle at radius R is a function only of n at R and the 
initial conditions: m, R t , and E m . That is, E M is independent of the 

shape of the ray path (any crazy curve) from Rj_ to R. 
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The following parameters are defined: 

R 0 = reference radius of Earth = 6 378 165 meters; value not critical 
R = Ro + h 

h = altitude above R 0 
hj_ = initial value of h 
hf = final value of h 

6 = central angle 
0i = zero 

0f = value at target 

= elevation angle of ray path 
= value of Em at target, final value 
Etyi = initial value of Em as measured by equipment 

ds = differential path length 

p = true, straight-line, geometric range 

E * true, geometric elevation angle 

c = speed of light in a vacuum 

n = index of refraction at h, equal to c/( speed of light at h) 

Ro 

( 2 ) 

the modulus of refraction. An exponential atmosphere is 
N = N 0 exp(-h/H s ) (3) 


n 0 = value of n at 
PM = measured range 



The value N = n-1 is 
assumed . That is , 


The symbol Hs is defined as atmospheric scale height. 

Values of N 0 and Hg are supplied by meteorologists. However, the following 
empirical relationship may be used for Hg (ref. 1): 


H S 


1000 


Hn 


N 0 - 7.32-10-6 exp(5577N 0 ) 


meters 


(4) 
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This value of H 5 is used at Johnson Space Center for processing radar tracking 
data. However, it may not be the best for opt-cal survey data. 

Figure 5(a) shows the differential path length element ds and its two 
components. Figure 5(b) shows the photon velocity along ds and its two 
components . 




(a) (b) 


Figure 5.- Differential geometry. 


Figure 5 shows that 

ds c 
dt n 


dh c 

— = - sin Em 
dt n " 


d0 1 c 
— = - - cos Em 
dt R n 


where, from equation ( 3 ), n is giver* as a function of h 


by 


(5) 

( 6 ) 

(7) 
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n = 1 + N = 1 + Nq exp(-h/Hg) (8) 


Note from equation (2) that 


dp M s nds 


And, using equation (5) 


dPM 

— = c (9) 

dt 


A.* . 'r^es'^ion for Efj is now required. Equation (1), the spherical form of 
Snell's law of refraction, could be used; however, it is fraught with numerical 
problems. For example, if E^ = 0, then h (eq. (6)) will remain at its 
initial value, hi. It has been determined that it is more accurate to develop 
a differential equation for E^ and integrate it. In equation (1), 


nR cos Ety s constant 


Differentiating with respect to time gives 


nR cos v nh cos E^ - nP E^ sin E^ = 0 


But, from equations (8) and (3) 


N o . N . 

n = - he-vH s h 

H S 


Thus, 


N . 

-R — h cos % + nh cos E^ - nR E^ sin = 0 
H s 


Using equation (6) for h 
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N c 

-R — - sin cos + c sin cos E M - nR E M sin % > 0 
He n 


H S 


And the equation for % is 


d% 

dT 


/I N \c 

= l )- cos % 

\ R hH s /n ^ 


( 10 ) 


Now, let 


a = ct 


(ID 


Then da = cdt and the resulting equations are summarized as follows. 



( 12 ) 

(13) 

(1H) 


(15) 


The initial conditions are 

a = 0 
h s hj_ 

6 S 6i S 0 

e M * %i 


And where 
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R = Ro + h 

(16) 

N = N 0 exp(-h/H s ) 

(17) 

n = N + 1 

(18) 

The equations are integrated from a = o 
mains is to obtain the expressions for p 
that 

to a s measured range. All that re- 
and E. It can be seen in figure 4 

Ri * Rq + hi 


E f s E o + 

A M 

• 


= Rf cos 0f - Ri 
Tg = Rf sin 0f 


! 

f~ 2 2 

! 

(19) 


o - yj t-j + t 2 

t 

! 

1 

E - arc tan (T 1 /T 2 ) 

! 

! 

! 

(20) 


4.0 INTEGRATING THE EQUATIONS 


A fourth order Runge-Ku^ta-Gill integrator has been found to be very suitable 
for most purposes. Other integrators may be found in reference 2. The Runge- 
Kutta-Gill integrator allows a maximum integration step size of about 10 000 
meters for even the most precise surveying work. 

Let the state vector x be defined by 


x = 



e M 


( 21 ) 
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Let 


dh/da 


f(x) = 


d9/da 


dE^/da 


Then the fourth order Runge-Kutta integrator equations (ref. 2) are: 


in = £ 

PM = PM + Aa 
kl = Aaf(x) 

x = in + a li£l 
k 2 = Aa f(x) 
x = x n + bik-j + b ?kp 
kj = Aaf(x) 

x = in + c liSl ♦ c pkp + c^kj 
k 4 = Aaf(x) 

x = Xjj + dik-| d ?k? + djkj + d^kij 
The Runge-Ku tta-Gill const, its (ref. 2) are: 


a-| = 1/2 

bi = ( V2-1)/2 

b 2 = (2- V2)/2 


c-j =0 

c 2 = -V2/2 

C3 = (2+V2)/2 


d! = 1/6 

d 2 = (2-V2J/6 . 

d 3 = (2+ V2)/6 

d4 = 1/6 


5.0 EXAMPLES 

Tables I and II show examples of refraction corrections for 

N 0 = 0.000395 
% = 5446 meters 


( 22 ) 
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^ s 0 meters 

= -0.239 degrees 

In tables I and II, Ap = - p meters and AE = - 


E milliradians. 
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TABLE I.- SHORT- AND MEDIUM-RANGE REFRACTION CORRECTIONS 


PM» m 

Ap, a 

AH, mrad 

PM» m 

Ap f ffl 

AE» mrad 

100 

0.0395 

0.00 357 

1 000 

0.3950 

0.03 624 

200 

.0790 

.00 721 

000 

.7903 

.07 250 

300 

.1185 

.01 084 

3 000 

1.1859 

.10 879 

400 

.1580 

.01 448 

4 000 

1.5817 

.14 509 

500 

.1975 

.01 810 

5 000 

1 .9779 

.18 141 

600 

.2370 

.02 173 

» 000 

2.5743 

.21 774 

700 

.2765 

.02 536 

coo 

2.7711 

.25 409 

800 

.3160 

.02 899 

S 000 

3.1680 

.29 046 

900 

•3555 

.03 261 

c 000 

3.5653 

.32 684 

1000 

.3950 

.03 624 

! 

10 000 

3.9628 

.36 324 
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TABLE II.- LONG-RANGE REFRACTION CORRECTIONS 


PM» * an 

hf, m 

BMf. deg 

Ap, m 

AE, mrad 

10 

-37.5 

-0.1909 

3.9628 

0.36 324 

20 

-66.6 

1 

• 

■fr 

O 

7.9512 

.72 806 

30 

-87.4 

-.0953 

11.9606 

1.09 418 

40 

-99.9 

-.0478 

15.9863 

1.46 133 

50 

-104.1 

-.0003 

20.0236 

1.82 923 

60 

-100.0 

.0472 

24.0678 

2.19 759 

70 

-87.6 

.0947 

28.1141 

2.56 615 

80 

-66.9 

.1424 

32-1577 

2.93 461 

90 

-37.9 

.1903 

36.1938 

3.30 271 

100 

-0.5 

.2384 

40.2176 

3.67 015 
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